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METHOD PND SYSTEM FOR PROVIDING INTERACTIVE LOOK-AND-FEEL - 

IN A DIGITAL BROADCAST VIA AN X-Y PROTOCOL 



BACKGROUND OF THE INVENTTOW 

This invention is directed to a digital video broadcast 
system and method, and, in particular to a system and method of 
providing interactive look-and-feel in a digital video broadcast 
system via an X-Y protocol which transmits from a head end server 
to a set- top box. 

Fully interactive television based on sessions between 
a server at a head- end and a client set-top box has proven to be 
very expensive and impractical for commercial applications at 
this time. However, less expensive one-way broadcast systems 
using satellites or microwaves are now being deployed which use 
digital video compression to provide an increased number of video 
channels to a. viewer. It is desirable to create a system that 
distributes digital video along with other data. Such other data 
can include a protocol which is usable to create a system that 
results in a look-and-feel of interactivity without transmission 
from the client set -top box to the head end server. 

U.S. Patent No. 3,991,266 (Baer) issued September 9, 
1976 and is directed to dual image television. In particular, 
this patent is directed to an early method for transmitting a 
sequence of horizontal video lines taken alternatively from two 
video sources, so that in one transmission when playing alternate 
horizontal video lines, either one of the video tracks may be 
played. 

Additionally, U.S. Patent No. 5,414,471 (Saitoh, et 
al.) issued May 9, 1995 and is directed to a moveable cursor for 
selecting and exchanging a main picture and subpictures in a 
multi-picture display device. The disclosure focuses on the 
picture selector and method of selecting the main picture or 
subpicture in a picture- in-a-picture system. More particularly, 
it is directed to a remote controlled mouse for selectively 
clicking on portions of a television receiver in order to receive 
a desired picture frame or channel by the click of a mouse. 

U.S. Patent No. 5,524,195 (Clanton, III, etal.) issued 
June 4, 1996 and is directed to a graphical user interface for 
interactive television with an animated agent. This is 
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essentially a video -on -demand system which includes a video-on- 
demand server coupled to a communication medium. A plurality of 
set top box receivers are coupled to the communication medium for 
receiving digitized programming in the form of movies and the 
like from the video-on-demand server. Each set top box includes 
a CPU which generates and displays a graphic user interface on 
the subscriber's television. The graphic user interface is used 
in order to choose the video-on-demand programming or the like 
from the communication network. 

Accordingly, many prior art systems and methods have 
been developed for generating video -on -demand, or picture within 
a picture. However, it is desirable and heretofore unknown how 
to develop a system and method for broadcasting video signals 
using satellites or microwave technology incorporated with 
protocol data and providing at the receiving end a set -top box 
or decoder that is adapted to receive the video information and 
protocol data and provide a user with a system having the look- 
and-feel of interactivity. The present invention details the 
private data which is interleaved within the data stream and 
provides protocol and synchronization information. 

■ 

SUMMARY OP TH E INVTlTCTTma 

Generally speaking, in accordance with the instant 
invention, a system is provided for creating a digital broadcast 
signal with X-Y protocol data and synch data. The digital 
broadcast signal can then be broadcast in any manner to be 
received at remote user locations. User's equipped with set-top 
boxes can then decode the digital signals. The goal is to 
provide a large quantity of information, so that a user may 
navigate through the information provided and obtain a look-and- 
feel of interactivity. 

The system includes an apparatus for receiving 
broadcast digital signals over a tuneable bandwidth, the 
broadcast digital signals representing digitally encoded and 
compressed video, audio or binary data (also generally referred 
to as eve it data) and private data or protocol data. Video data 
as used herein may describe full motion video (with or without 
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audio) or still picture graphics. The apparatus includes a tuner 
for selecting the tuneable frequency bandwidth and selecting the 
digital information for video and- interactivity in synchronous 
groups, where each synchronous group has predetermined links 
defined by link data. The apparatus uses the private data or 
protocol data to provide a user with the ability to select from 
indicia of predetermined links and upon such selection, the 
monitor displays the predetermined link chosen. The apparatus 
is also equipped to provide the user with the ability to select 
from the predetermined links, which are displayed on the monitor 
as the indicia, so that new video as defined by the link may be 
displayed. 

A set -top box or apparatus is located at user locations, 
such as a user's home or other viewing spot. It is provided for 
processing broadcast digital signals from tuneable frequency 
bandwidths. A member is provided for receiving the broadcast 
digital signal and generating a playable signal including indicia 
of the protocol . data, and the protocol data includes 
predetermined links to associated playable signals. A member is 
provided for transmitting the playable signal for display on the 
display device. A remote control or other input device allows 
the user to select from the indicia displayed on the display 
device. The user may then exercise the predetermined link 
associated wich a selected indicia in order to obtain the desired 
playable signal. 

More specifically, the broadcast digital signal 
includes two components generally referred to as event data and 
private data. The event data includes but is not limited to 
audio data, video data and other binary data such as text. The 
private data includes information often referred to as protocol 
data. In other words, the private data is akin to a road map 
which instructs the receiver how to access the event data. 

Accordingly, it is an object of the invention to 
provide a system and method that gives an interactive look-and- 
feel to a unidirectional digital video broadcast system. 

A furth jr object of the invention is to provide 
synchronous information that is displayable on a monitor and 
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easily accessible by a user, so that a single channel of 
information received can display multiple programs simply and 
easily. 

Another object of the invention is to provide X-Y 
protocol data with program data to allow a feeling of 
interactivity to a user via a remote control, mouse or other 
similar interface. 

Still other objects and advantages of the invention 
will in part be obvious and will in part be apparent from the 
specification. 

The invention accordingly comprises the several steps 
and the relation of one or more of such steps with respect to 
each of the others, and the apparatus embodying features of 
construction, combinations of elements and arrangement of parts 
which are adapted to effect such steps, all exemplified in the 
following detailed disclosure, and the scope of the invention 
will be indicated in the claims. 

BRIEF DESrP IPTTnM np THE DRAWTWr.g 

For a fuller understanding of the invention, reference 
is made to the following description taken in connection with the 
accompanying drawings, in which: 

Fig. 1 is a block diagram of a one way digital 
broadcast system; 

Pig. 2 is a schematic representation of video channels 
received in tuneable bandwidths; 

Fig. 3 is a schematic representation of a television 
screen including plural hot-spots; 

Fig. 4 is an alternative embodiment of a video screen 
including plural hot-spots; 

Pig. 5 is a block diagram of a system for encoding 
video information and data into synchronous information channels 
capable of broadcast; 

Fig. 6 is a flow chart illustrating the flow of logic 
in the head end; 

Fig. 7 is an exem_ilary switch schedule; 
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Pig. 8 is an exemplary MPEG2 transport stream with X-Y 
protocol data arid synchronization data illustrated; 

Fig. 9 is a block diagram of hardware for a set-top box 
for decoding X-Y protocol; and 

Fig. 10 is a logic flow diagram for the set -top box in 
accordance with the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference is now made to the figures which illustrate 
the exemplary embodiments of the present invention. with 
particular reference to Fig. l, a one way digital broadcast 
system, generally indicated as 100, constructed in accordance 
with, the instant invention, is depicted. One way digital 
broadcast system 100 generally includes a head end generally 
depicted at 102 and a receiving end generally depicted at 104. 
Head end 102 includes a head end system 106 coupled, in this 
embodiment, to a microwave transmission dish 108. Receiving end 
104 includes a microwave receiving antenna 110 coupled to a set- 
top box 112 which is in turn coupled to a television monitor 114 . 
The transmission in this embodiment is direct dish-to-dish 
microwave. An alternative method of direct broadcast can 
communicate with a satellite which retransmits to the receiving 
system. Even a wire connection can be used as the digital 
broadcast medium. 

Head end system 106 generally includes system required 
for digital video transmission and sometimes encoding. The 
exemplary system is described in more detail in connection with- 
Figs. 5, 6 and 7. Set-top box 112 generally includes circuitry 
for digital video decoding and is described in more detail in 
connection with Figs. 9 and 10. In operation, a digital video 
signal is generated at head end system 106 and is transmitted 
from microwave transmission dish 108. The digital video signal 
is received by microwave receiving antenna 110 and is converted 
by set-top box 112 into a usable signal which is then input into 
television monitor 114 for viewing. 

Reference is next directed :o Fig. 2 which illustrates 
several digital video channels 120-130. In the preferred 
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embodiment of Fig. 2, video channels 120-130 are representative 
of MPEG channels 21-31, respectively. Digital video channels 
120-130 and data channel 131 are transmitted in tuneable 
bandwidths represented by frequency bands 140 and 142. In this 
exemplary embodiment, frequency band 140 contains MPEG channels 
21-2S {digital video channels 120-125) and frequency band 142 
contains MPEG channels 27-31 (digital video channels 126-130) . 
Each of the digital video channels can have data embedded in its 
stream of data as shown in frequency band 140. Alternatively, 
a separate data channel 131 can be independent from each of the 
digital video channels 126-130 but within the same tuneable 
bandwidth as in frequency band 142. Alternatively, the data can 
be put on a data dedicated frequency band which receives only 
data and no digital video channels, such as the situation of data 
132 tuneable by frequency band 143. 

Frequency band 140, contains digital video channels 
120-125 which include both video information and data, such as 
X-y protocol data. Frequency band 142 tunes digital video 
channels 126-130 and data channel 131. Data channel 131 includes 
a continuous stream of data that is then synchronized to the 
separate digital video channels 126-130, such that the separate 
digital video channels 126-130 have the appropriate synchronized 
X-Y protocol data. 

Alternatively, in the situation of frequency band 143, 
one dedicated frequency band is provided to receive only data 
bits. Data must be stored in memory and synchronized with video 
only when tuned to a frequency band that has video. 

A preferred use for this system is to provide standard 
and premium television channels, movies and pay-per-view events 
through the separate channels. However, it is also possible to 
provide services other than video from any of the digital data 
streams 120-132. For .example, pages of any kind of text, picture 
and other multimedia elements could be encoded as hypertext 
markup language (HTML) data with accompanying files such that 
world wide web-like pages can be delivered to the television 
screen. This assumes that the television's dsual resolution 
limitations are contemplated. of primary importance is that 
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since there is ho communication between the set top box at the 
user site and the head end server, the data must be continuously 
rebroadcast from the head end server. Accordingly, when the set- 
top box at the user site needs to access data from any of 
channels 120-132, there is only a reasonable amount of lag time 
needed to find the appropriate data. 

With particular reference to Fig. 3, a typical monitor 
201 is illustrated. Monitor 201 includes a screen 203 with four 
hot-spots 205, 206, 207 and 208 indicated thereon. The hot-spots 
are predetermined areas on the screen that can be accessed by a 
remote control, moveable cursor or mouse (not shown) . A hot-spot 
is a dedicated area of the monitor screen. When a hot-spot is 
accessed it provides a link to a video, audio, graphics or data 
event, for example, one of the video channels 120-130. The hot- 
^P°^ is defined by predetermined coordinates. For example, in 
Pig. 3, the upper left hand corner of hot-spot 205 is defined by 
coordinates xl = 100, yi » 90 and the lower right hand corner is 
defined by coordinates x2 = 300, y2 = 220. Using this 
information, the computer program can draw a rectangle 
representing the hot-spot and the program can test to see if that 
hot-spot is active. When the user makes a selection (usually by 
activating a button on a controller such as an infrared remote 
control) , if the set -top box finds that a hot-spot exists and is 
currently activated, the program automatically changes the state 
of the screen being , displayed, so that it links to the event 
indicated by the. hot-spot . In the typical situation, this wov,ld 
be a different video sequence. However, it may be other 
information such as alternate audio, graphics, text or another 
appropriate program like a game. 

In digital television applications the background 
behind the hot-spots can frequently be video. Since video 
changes every frame (l/30th of a second in NTSC) , an application 
may have to change the location of the hot-spots and the 
associated link events every frame- Alternatively, if the hot- 
spots are relatively stationary, the background may continue to 
change although the same protocol may exist for the hot- spot for 
a prolonged period. 
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In one exemplary embodiment of the screen layout of Fig. 3, 
each hot-spot might overlay the video of a separate movie. The 
user would select between the various hot-spots using a remote 
unit. Upon activation of the remote on the desired selected hot- 
spot, the system may either provide data (for example in the form 
of text), or link to the video channel playing the movie. 

An alternative X-Y protocol is illustrated for the non- 
rectangular hot-spot as illustrated in Fig. 4. in Pig. 4, video 
monitor 201 and screen 203 include hot-spots 210 and 211 which 
are non- rectangular . In this embodiment, the hot-spot is defined 
by all four corner positions. m other words, the upper left 
hand corner of the hot-spot is defined by xl = 300, yi = 80, the 
upper right hand corner is defined by x2 = 400, y2 = 95,' the 
lower left hand corner is defined x3 = 300, y3 = 220 and the 
lower right hand corner is defined by x4 = 4 00, y4 « I8O. Then, 
the computer program defines the hot-spot by drawing . lines 
between each of the corners. Thus, if the area is selected 
inside of the hot-spots defined by the four corners, the program 
will link to whatever the hot-spot is linked to. In the 
preferred embodiment as defined more particularly in Figs, and 
10, the remote control includes directional buttons for selecting 
the hot-spot to be highlighted. A second selection button is 

provided for actually selecting the highlighted hot-spot. When 

the selection is made, the program changes from multi-screen 
display to displaying the single selected event. Inherent within 
this protocol system is the fact that a five or six sided polygon 
can also be mapped out in the same fashion. Additionally, the 
protocol system illustrated in connection with Fig. 3 is useful, 
for other hot-spots which are not rectangular. By specifying the 
number of comers of a polygon and the coordinates of those 
comers, hot-spots which are beyond trapezoids, like pentagons, 
hexagons and so on can be handled efficiently. 

When the screen is changed, and accordingly the hot- 
spots are changed, the new hot-spot information must be 
synchronized with the underlying video. This is accomplished by 
a synchronization time. m fact, anytime the hot-spot 
information is changed a synch time must be used. The 
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synchronization time is a time corresponding to a specific point 
m the underlying video where the hot-spots should change. So 
providing the time code (for example, SMPTE time code or other) 
of the frame of the underlying video is a good sync time assuming 
that the system can determine when the time coded video is 
played. In the preferred embodiment, the synchronization time 
IS expressed as a time code of the first frame that should use 
the new interactive data. Time code is not the only way to 
provide synch data. The synchronization data can also be 
provided by matching the hot-spot change event with a change in 
program identification data (PID) or other event in the MPEG 
stream. Synchronization does not have, to happen in every video 
frame as long as the interactive information does not drift 
perceptively from the timing dictated by the underlying video 

For example, the corners of the hot-spots could be 
gxven a trajectory. All x positions could move one position to 
the right on every video frame . The computer program can move 
the rectangle on every vertical blank of the video and thus move 
the hot-spots without any further synchronization information 
Even more complicated trajectory functions can be used, so long 
as synchronization data is given frequently enough to keep synch. 

Another example of synchronization is used when the 
timing of the hot-spots only needs to be loosely synchronized 
with the video, in this case, the protocol data is transmitted 
at approximately the same time as the video data to which it is 
loosely synchronized. In this method the new protocol data is 
activated immediately upon reaching the set-up box. This is 
acceptable because the video will probably be within one second 
or so of that time. 

Attention is next directed to Fig. 5 which is a block 
diagram of a preferred embodiment of the system for encoding 
video information and -data into synchronous information channels 
capable of being broadcast. The system generally receives video 
signals 301-312 (as used herein video signals 301-312 may each 
include audio data, video data, and binary data which is also 
referred to generally as "event data"), which are input into a 
video switch 314. Video switch 314 selectively outputs chosen 



9 



4) 



WO 98/28907 PCT/US97/23984 

video signals of video signals 301-312. As illustrated in the 
example of Pig. 5, video signals 303, 305, 308, 311 are 
selectively output from video switch 314. The selected video 
signals are input into video effects device 316. Video effects 
device 316 then outputs a multi-screen video signal 317 to video 
monitor 318 and MPEG encoder 320. An MPEG signal is then output 
by MPEG encoder 320 to remultiplexer 324. Remultiplexer 324 
outputs a. signal that is MPEG encoded with interleaved protocol 
data and synch data. 

computer 322 is electrically coupled to video switch 
314 and transmits a signal to switch 314. The signal from 
computer 322 causes switch 314 to select which video signals 301- 
312 are output by video switch 314. Computer 322 is also 
electrically coupled to remultiplexer 324 and transmits 
information to remultiplexer 324. The information from computer 
322 provides remultiplexer 324 with X-y protocol data and 
synchronization data for- the output MPEG signal. Remultiplexer 
324 then outputs an MPEG signal complete with the composite of 
multiple channels of video information, X-Y protocol data and 
synchronization data. 

In operation, video switch 314 receives a plurality of 
video signals 301-312. (m an alternative embodiment there may 
only be one video signal . ) The video switch is programmed by 
computer 322 via control signal 326. Control signal 326 
determines which video channels 301-312 are passed through video 
switch 314. In the present example, video channels 303, 305, 308 
and 311 are passed through video switch 314. in practice, the 
output combination is set for a predetermined period, such as two 
minutes, as described in the Switching Schedule (Fig. 7) . At 
certain predetermined times, computer 322 changes control signal 
326 such that switch 314 outputs different video channels 301-312 
to video effect device 316. Video effect device 316 receives 
four input video signals and modifies the four video images to 
reduce them in size, so that all four images can be displayed in 
a single multi-screen video image that, can be viewed on video 
monitor 318. An example of a video effect device is the Picara 
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Q from Active Imaging. Other such video effects devices are also 
available as common television studio equipment. 

Video effect device 316 outputs a multi-screen video 
image which is received by MPEG encoder 320. MPEG encoder 320 
converts the video input into digital video. MPEG encoder 320 
then outputs an MPEG encoded signal to remultiplexer 324 which 
receives the X-Y protocol data and synchronization data for the 
next set of video images from computer 322. Remultiplexer 324 
then interleaves the X-Y protocol data and synchronization data 
into the digital video data and outputs a stream of data in MPEG 
format. In other words, the MPEG channel (illustrated as MPEG 
channel 21) output in Fig. 5 is similar to the MPEG channel of 
data 120 of Pig. l. 

The system is designed to give a feel of interactivity. 
Accordingly, the required X-Y protocol data and digital 
i*hf ormation must be provided on a substantially continuous basis . 
Thus, when a state change is going to occur by the user accessing 
a hot-spot with the interface, the system must in effect, 
anticipate such a change and provide information for the 
anticipated change. As an example, the X-Y protocol data 
describes the information for the switch in video source at 
switch 314 that is going to occur in the following time period. 
Examples of equipment for the devices in Fig. 5 are: Philips 
Venus Routing Switcher wich Jupiter Control System-Switch; Picara 
Q by Active Imaging-Video Effects Device; and Divicom MV20 and 
MN20-Ehcoder/Remultiplexer. 

The first stream of information travels in a path from 
video switch 314 to video effects device 316 to MPEG encoder 320 
and out remultiplexer 324. This information path creates a 
multiscreen display (four or more pictures on one screen) . 
Additionally, video channels 301-312 can be input straight into 
-MPEG encoders 321. The MPEG encoded signals from MPEG encoders 
321 are then input into remultiplexer 324 and are interleaved 
with X-Y protocol data and synch data. Thus, the remultiplexer 
outputs a plurality of MPEG channels with X-Y protocol data and 
synchronization data interleaved therein that are tuneable to a 
single frequency band. in this exemplary embodiment, MPEG 
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Channels 21-26 are all tuneable to one frequency band. The set 
top box described in connection with Figs. 9 and 10 is 
responsible for decoding this information. 

Particular reference is next directed to Fig. 6 which 
18 a flowchart illustrating the computer control process for 
switching video and transmitting X-Y protocol data. The process 
begins at block 350, with the initialization of the process The 
process then moves to block 352 and accesses the switching 
schedule and reads the switching schedule. The switching 
schedule is illustrated and discussed in more detail in 
connection with Fig. 7. Next, the process moves to logic block 
354 and asks whether the present time equals the switch time 
minus a predetermined lead time. If the answer is "yes, " present 
time equals switch time minus the predetermined lead, the process 
moves to block 356 and begins sending the next X-Y protocol data 
to the remultiplexer, which is illustrated as remultiplexer 324 
Of Fig. 5. After completing logic block 356, or if the answer 
in logic block 354 is -no, « the process moves to logic block 358 
and asks whether present time is switch time, if the answer is 
no," present time is not switch time, the process loops back to 
logic block 354. Alternatively, if the answer is "yes" in logic 
block 358, present time is switch time, the process moves to 
logic block 360 and sends the switching commands to the video 
switch. The process then returns to logic block 352 and repeats 
the process indefinitely. 

Particular attention is next directed to Fig. 7 which 
Illustrates exemplary data for the switching schedule The 
switching schedule is a continuous schedule that can be on any 

time hac-io A-^ 



in the embodiment illustrated in Fig. 7 two 
iterations of the switching schedule are provided: one at time 
- 11:28:00:00 and the second at time 11:30:00:00.. At time 
11:28:00:00 video switch C is indicated by the hot-spot located 
at xlMO, yl=60, x2=300, y2=220 and is associated with link event 
27. Video switch E is associated with the hot-spot located at 
xl=340, yi»60, x2=500, y2=220 and link event 29. Video switch 
H IS associated with hot-spot xl=40, yl=260, x2=300, y2=420 and 

ft 



12 



wo 98/28907 PCTAJS97/23984 

link event 47. Video switch K is associated with hot-spot 
xl=340, yl=260, x2=500, y2=420 and link event 42. 

Particular attention is now directed to FIG. 8 which 
illustrates how the X-Y protocol data is embedded in an MPEG2 
transport stream, which is generally indicated at 370. MPEG2 is 
the present industry standard for transmission of video signals. 
As described . above , in a system operating under the present 
invention many data streams containing audio, video and data are 
transmitted. The data is transmitted in the N private data 
bytes. Part of the N private data bytes are dedicated to one of 
the X-Y protocol data segments for the first of the hot-spots 
described in the switching schedule (FIG. 7). The X-Y protocol 
is a tagging mechanism which associates a tag with a viewing 
event. The X-Y protocol tag is generally indicated at 372. The 
X-Y protocol tag has a unique event identification (event id 374) 
and a set of hot spots. 

In the exemplary embodiment of FIG. 8, the event id is 
85. There is one hot-spot and it is located at coordinates (40 
60 300 220) . In other words the hot-spot is located at x1b40, 
yl=60, x2=300, y2=220. This hot-spot links to link event 27^ 
The new context is "view" and the media type of the new event is 
video. The "new context" and "media type" fields are examples 
of other types of data that can be included in the data stream. 
The payload field provides the synchronization information. The 
payload data is further broken out such that the length is 9. 
There is 1 item which contains 4 bytes, and it is located a 
synchronization time 11:28:00:00. 

Particular attention is now directed to Fig. 9 which 
is a block diagram representing sample hardware required for 
decoding the X-Y protocol. In particular, the set-top box is 
generally indicated as 112. Set-top box 112 generally includes 
input connector 402 electrically coupled to tuner 404. Tuner 404 
is connected to demultiplexer 406 and processor 410. 
Demultiplexer 406 is additionally connected to processor 410, 
dynamic RAM 408 and MPEG memory 412. Dynamic RAM 408 is 
adeitionally connected to processor 410. Processor 410 is 
electrically connected to infrared input 416 and overlay graphic 
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memory 414. Overlay graphic memory 414 is connected to MPEG 
memory 412 as well as television 420 which is outside of set-top 
box 112. An infrared remote unit 422 is required to access 
infrared input 416 to request interactivity. 

Set-top box 112 receives a signal from an antenna, such 
as microwave receiving antenna lio of Fig. i, and the signal is 
input through input connector 402 at the back of set-top box 112 
Tuner 404 receives the complete signal including all the various 
decodable channels from all of the various frequency bands 140, 
142, 143, etc. as illustrated in Pig. 2. Tuner 404 is 
responsible for tuning in the appropriate frequency band for the 
requested video signal . The appropriate MPEG channel received 
IS then demultiplexed by demultiplexer 406. in other words, the 
video information and other data such as audio and X-Y protocol 
data are separated. The MPEG data is then fed to MPEG memory 412 
where it is turned into audio and video information, and the X-Y 
protocol data is transmitted to dynamic RAM 408 where it is 
accessible by processor 410. 

Processor 410 creates transparent overlays for the 
video by drawing polygons in overlay graphics memory 414 which 
can be seen as a highlight over the video on television monitor 
420. User input from remote unit 422 is detected by the set- top 
box's infrared input circuitry 416 and passed on to processor 410 
which can change the location and shape of the polygon. Also, 
when the user activates the select button on remote 422, 
processor 410 can cause the tuner 404 and demultiplexer 406 to 
change the channel or provide some other event stored in dynamic 
RAM 408. 



Particular attention is next directed to Fig. 10 which 
is a data flow diagram illustrating the processes of decoding the 
received signal and the appropriate protocol for the multi-screen 
video mode of operation. The process is initiated at logic block 
450 where the user requests mult i- screen video via remote control 
422. The process then moves to block 452 where the application 
program causes the set-top box to tune to the frequency band for 
the multi-scr^en video and to begin retrieving data packets with 
program identifications for audio, video and X-Y protocol data 
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for the multi-screen video channel. The process then moves to 
logic block 454 and asks whether the data accessed in block 452 
is the first X-Y protocol data. If the answer "yes," the data 
is the first X-Y protocol data, then the process moves to block 
456 and establishes the current interactive events and highlights 
the default interactive event. 

After completion of block 456, or if a "no" response 
is determined in logic block 454 (this is not thjs first X-Y 
data) , the process moves to logic block 458. In logic block 458, 
the process asks whether there is new X-Y protocol data. If a 
"yes" response is determined indicating there is new X-Y protocol 
data, the process moves to block 460 and establishes the next 
interactive event. If a "no" response is received in logic block 
458, or after completion of step 460, the process moves to block 
462 and asks whether the data received is synchronization data, 
rf a "yes" response is determined in logic block 462 indicating 
that synchronization data has been received, the process moves 
to block 464 and updates the interactive event. Alternatively, 
if a "no" response is determined in block 462, or after 
completion of block 464, the process moves to logic block 466. 
In logic block 466, the process asks whether the event select 
button was pressed on the remote. if a "yes" response is 
determined, indicating the event select button was pressed on the 
remote, the process moves to block 470 and changes the channel 
to link the appropriate signal to television monitor 420 so that 
the appropriate event is displayed or otherwise uses data in the 
memory or in transmission to present the appropriate event.. 

If the event select button is not pressed on the 
remote, a "no" response is determined in block 466 and the 
process moves to block 472 and asks whether a directional button 
was activated, if a directional button was activated, a "yes" 
response in block 472 is determined, and the process moves to 
block 474 to change the highlighted event. The highlight on 
television monitor 420 is . then appropriately adjusted. 
Alternatively, if a "no" response is determined in block 472 
indicating that no dir ictional button was activated, the process 
loops back to logic block 454. 



■ 
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In the illustrative example of Fig. lo, MPEG channel 
21 is input into decoding hardware 480. The decoding hardware 
then outputs the X-Y protocol information to logic blocks 454 and 
458. This information is used to determine which X-Y protocol 
information is being accessed. Additionally, decoding hardware 
480 outputs synchronization data to logic block 462. Audio and 
video information are output from decoding hardware 480 to 
monitor 420. 

Fig. 10 illustrates the process of decoding the 
information (audio, video, synchronization data and X-Y protocol 
data) received at the set-top box. The process begins when the 
user presses a button on the remote control 422 and enters the 
multi-screen video mode of operation (block 450) for the system. 
The computer program's logic begins by initialization in block 
452 which includes setting the set-top box hardware to tune to 
the frequency band which has the multi-screen MPEG channel and 
starts decoding the data packers with program identifications for 
audio and video, X-Y protocol data and synchronization data. 

Once the decoding begins, audio and video information 
are converted to a composite television signal and passed to a 
television set (monitor 420). The computer program searches 
primarily for the first X-Y protocol data (logic block 454). 
When the first X-Y protocol data is detected, the data is set in 
memory as the current X-Y data and a highlight is drawn on 
television monitor 420 over the first hot-spot. Subsequent logic 
in the event loop, checks for new, different X-Y data to arrive 
(logic block 458) . When new data arrives it is held in the "next 
X-Y data" memory location (not shown) until synchronization data 
is detected (logic block 462) . When the synchronization data is 
detected, the current data is updated to the new data. 

The event loop also detects the state of the remote 
control button pushing. if the "select" button is detected 
(block 466), the program will link to the proper event (block 
470) and display that event and terminate the multi -screen video 
logic. Alternatively, if a direction button is pushed (block 
472), the highlight is redrawn around the appropriate hot-spot. 
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Accordingly, general review of Fig. 10 illustrates one 
simple continuous loop for multi-screen video viewing. The loop 
detects additional X-Y protocol data, stores the data, and 
detects synchronization data. The loop also detects 

transmissions from the remote control that cause the status of 
the mult i- screen video to change, such as selecting one of the 
events on the multi-event screen, or changing the event on the 
multi-event screen . that is highlighted. In this way, the 
appearance of interactivity is experienced by a user with 
unidirectional data transfer. No data is transferred from the 
set -top box to the head end. 

The present invention is thus directed to a system and 
method for providing a user with an interactive look-and-f eel in 
a digital broadcast. Users sitting at remote locations such as 
their homes would, for example, watch television and a set-top 
box would be provided for decoding the digital broadcast signal 
received. The ' invention allows a user to watch television in 
various different modes. For example, in one mode the television 
would display a plurality of separate videos (each video enclosed 
in a hot-spot) and a user could select any of the plurality of 
videos on the screen for display on a full screen. In essence, 
the user would enter a command on a remote control and one of the 
multiple screens would be displayed in full. A different example 
would include a program schedule on the screen, where each line 
of program information includes X-Y protocol data, such that each 
line is a hot-spot. When the user executes on a hot-spot he/she 
would receive either text (binary data) regarding the program, 
or in the alternative, would be connected to the actual program 
(video and audio) . Thus, the system provides the appearance of 
interactivity. 

It will thus be seen that the objects set forth above, 
among those made apparent from the preceding descriptions, are 
efficiently attained and, since certain changes may be made in 
the carrying out of the above process, in the described product, 
and in the construction set forth without departing from the 
spirit and scope of the invention, it is : ntended that all matter 
contained in the above description and shown in the accompanying 
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drawings shall be interpreted as illustrative and not in a 
limiting sense. 

< . that the following claims 

are intended to cover all the generic and specific features of 
the .nvent.on herein described a„a all statements of the s op! 
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Claim^ 
What is claimed is: 

1. A system for providing an interactive look-and- 
feel in a playing device receiving a digital broadcast, 
comprising : 

a signal generator which generates a digital 
signal comprising interleaved bits of at least one of audio, 
video and binary data for play on a playing device, and private 
data ; 

the private data includes an event identification 
for said at least one of audio, video and binary data and an 
indication of a number of hot-spots for linking to additional at 
least one of audio, video and binary data, each hot-spot being 
linked to said additional at least one of audio, video and binary 
data by link data, said link. data including a set of coordinates 
defining a location on the playing device, link event 
identification indicating the additional at least one of audio, 
video and binary data coupled to the set of coordinates, and 
synchronization time indicating the temporal position of the 
additional at least one of audio, video and binary data; 

means for broadcasting said digital signals; and 
a receiver which receives said digital signal at user 
locations and plays at least one of said audio, video and binary 
data on. said playing device, and is adapted to selectively 
exercise upon a hot-spot by reading said link data and playing 
said additional at least one of audio, video and binary data on 
said playing device. 

2. The system as claimed in claim 1, wherein said 
generator includes means for receiving a plurality of data 
streams, each data stream including at. least one event. 

3. The system as claimed in claim 2, wherein said 
generator includes means for selecting at least one of said 
plurality of data streams. 

4. The system as claimed in claim 1, wherein the 
playing device is a television. 
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5. The system as claimed in claim 4, wherein the set 
of coordinate define X and Y position on a two dimension matrix 
defined by the television screen. 

6. The system as claimed in claim 5, wherein the 
receiver generates a polygon by connecting the X and Y 
coordinates . 

7. The system as claimed in claim 1, wherein said 
link data is continuously updated as the at least one of audio, 
video and binary data is played. 

8. An apparatus for processing broadcast digital 
signals from tunable frequency bandwidths, said broadcast digital 
signals including event data for play on a playing device, and 
private data, comprising: 

a receiver which receives the broadcast digital signals 
and generates playable signals from said event data and reads 
said private data; 

said private data including an event identification for 
associated event data, an indication of a number of hot-spots for 
linking to additional event data, and link data associated with 
each hot-spot, said link data including a set of coordinates 
defining a location on the playing device, link event 
identification indicating the additional event data coupled to 
the set of coordinates, and synchronization data indicating the 
temporal position of the additional event data; 

said receiver providing an indicia of the hot spot; 

a transmitter which transmits said playable signals and 
said indicia for play on said playing device; and 

a selector which enables a user to select from at least 
one indicia. displayed on said playing device and to exercise the 
link data associated with the selected indicia in order to obtain 
a desired playable signal. 

9. The apparatus as claimed in claim 8, wherein said 
synchronization data includes a time code included within the 
link data which is synchronized to the same time code in the 
event data. 
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10. The apparatus as claimed in claim 8, wherein said 
synchronization data indicates when said predetermined link is 
to be changed. 

11. The apparatus as claimed in claim 8, wherein said 
synchronization data includes payload information. 

12 . The apparatus as claimed in claim 8 , wherein said 
synchronization data includes information regarding, the size of 
the additional event data. 

13. The apparatus as claimed in claim 8, wherein said 
synchronization data provides for a loose synchronization by 
activating the link data immediately upon receipt and processing 
in the apparatus. 

14 . The apparatus as claimed in claim 8 , wherein said 
receiver includes a tuner for isolating selected event data. 

apparatus as claimed in claim 8, wherein said 
event data includes at least on of audio data, video data and 
binary data. 

16. The apparatus as claimed in claim 15, including 
a demultiplexer for receiving said selected event data, and 
separating said private data and binary data from at least one 
of said selected video and audio data. 

17. The apparatus as claimed in claim 16 further 
including a storage for storing said selected at least one of 
video, audio and binary data and private data. 

18. The apparatus as claimed in claim 17, wherein a 
first portion of said storage stores said video data and audio 
data and a second portion of said storage stores said private 
data and binary data. 

19. The apparatus as claimed in claim 17, further 
including a processor for accessing said selected at least one 
of video, audio, binary data and private data from said storage 
and effectuating said links. 

20. The apparatus as claimed in claim 19 further 
including a graphic memory device for overlaying said selected 
at least one of video, audio and binary data from said storage 
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with indicia in the graphic memory occupying the set of 
coordinates within a matrix of information to be displayed. 

21. The apparatus as claimed in claim 20, wherein said 
set of coordinates define comers of a hypothetical polygon to 
be mapped in said matrix. 

22. The apparatus as claimed in claim 21, wherein said 
processor maps out a said hypothetical polygon from said private 
data in said graphic memory. 

23. The apparatus as claimed in claim .19, further 
including a second receiver which receives a user input. 

24. The apparatus as claimed in claim. 23, wherein said 
second receiver is electrically coupled to said processor. 

25 . The apparatus as claimed in claim 24 , wherein said 
processor selectively modifies said indicia in response to said 
second receiver. 

26. The apparatus as claimed in claim 24, wherein said 
processor selectively activates said link data in response to 
said second receiver. 

27. The apparatus as claimed in claim 26, wherein said 
link data is activated by said processor communicating with at 
least one of .said tuner and said demultiplexer to select at least 
one of said video, audio, binary data and private data. 

28. The apparatus as claimed in claim 26, wherein said 
link data is activated by said processor communicating with said 
storage to select at least one of said audio, video and binary 
data to be played. 

29. The apparatus as claimed in claim 8, wherein said 
selector is included on a remote control. 

30. A method of providing an interactive look-and-f eel 
on a playing device receiving a digital broadcast, comprising the 
steps of: 

generating a digital signal comprising interleaved 
units of event data and private data; 

synchronizing at least a portion of said event data 
with said, private data, wherein said synchronization is 
accomplished by transmitting said event data with interleaved 
private data including event identification and link data 
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including link locations, link event identification and 
synchronization data; 

broadcasting said digital signal; 

receiving said digital signal at remote locations and 
playing event data on said playing device; 

overlaying said event data with indicia of at least a 
portion of said link data positions defined by said link 
locations ; and 

changing said event data based on user preference in 
selecting an indicia. 

31. The method as claimed in claim 30, • wherein the 
step of generating includes the step of determining positions 
within said at least one of audio, video and binary data for 
interleaving said protocol data. 

32. The method as claimed in claim 31, wherein the 
step of generating includes the steps of receiving a plurality 
of data streams, each data stream representing at least one 
event, selecting at least one of said plurality of data streams, 
defining link locations as a set of X-Y coordinate locations, 
associating a link event identification for each set of X-Y 
coordinate locations, determining temporal position within said 
data stream, and inserting said set of X-Y coordinate locations 
and link data within said data stream. 

33. The method as claimed in claim 31, wherein said 
step of synchronizing includes inserting a synchronization time 
code within said private data which is synchronized to a time 
code within said event data. 

34. The method as claimed in claim 31, wherein said 
step of synchronizing includes interleaving said synchronization 
data within said event data, event identification, link location 
and link event identification at predetermined times. 

35. The method as claimed in claim 30, wherein said 
step of synchronizing includes positioning said private data such 
that it is activated immediately upon receipt and processing by 
said playing device. 

36. The method as claimed in claim 30, wherein said 
broadcasting is direct dish-to-dish microwave broadcasting. 
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37. The method as claimed in claim 30, wherein said 
broadcasting is via satellite transmission to a retransmission 
station. 

38: The method as claimed in claim 30, wherein said 
broadcasting is from a head end through a wire communication 
network . 

39. The method as claimed in claim 30, wherein said 
synchronization data includes a synchronization time, link event 
length and the number of bytes in the link event. 

40. The method as claimed in claim 30, wherein a 
user's selection of an indicia causes said link data to be 
exercised. 

41. A method of generating a broadcast digital signal 
including protocol data, comprising the steps of: 

receiving a plurality of data streams, each data stream 
representing at least one event; 

selecting at least one of said plurality of data 

streams; 

defining a set of X-Y coordinate locations as hot- 
spots; 

associating link data with each hot-spot, said link 
data defining a link event; 

determining temporal position within said data stream 
for said set of X-Y coordinate data and link data so that 
synchronization of said event with said X-Y coordinate data and 
link data is essentially achieved; and 

inserting said X-Y coordinate and link data within said 
data stream. 
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NO 


Norway 


zw 


Zimbabwe 


a 


C6te d*lvoire 


KP 


Demociatic People'a 
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China 
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Republic of Korea 


PT 


Piortugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 
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Czedi Republic 


LC 
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RU 


Russian Federation 
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SD 
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SE 
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SG 


Singapore 







INTERNATIONAL SEARCH REPORT 



Interaational application No. 
PCTAJS97/23984 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :Ha4N 5/445, 9/74, 5/44 
USCL :455/3J2; 380/34; 348/725, 726, 563. 564» 5S9 
According to loteraatioDal Patent ClassiGcation (IPC) or to both national classification and IPC 

R FIELDS SEARCHED 

Minimum documentation searched (classification system followed by classification symbols) 

U.S. : 455/3.2; 380/34; 348/725. 726, 563. 564. 589 
Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
APS - satellite, tv, menu, x-y, selection, interactive, receiver, time, digital, syncrfaontzation 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



CitAtioo of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



X.P _ 



A,P 



A,P 



..US 5,619,274 A (ROOF etal) 08 April 1997, col. 3, lines 1-67, col. 
4, lines 1-67, col. 5, lines 1-67, col. 6, lines 1-67, col. 7, lines 1- 
67, col. 8 lines 1-67, col. 9, lines 42-53, col. 13, lines 24-31, col. 
15, lines 8-25, col. 67, lines 35-58, col. 68, lines 16-35, fig. 4, fig. 
17, fig. 44, fig. 45, fig. 46, fig. 47. fig. 48, fig. 49, fig. 50 

US A 5,682,206 (WEHMEYER et al) 28 October 1997 

i 

US A 5,001,554 (JOHNSON et al) 19 March 1991 
US A 5,624,265 (REDFORD et al) 29 April 1997 



1-41 



1-41 



1-41 



1-41 



1 ] Further documents are listed in the continuation of Box C. | | See patent family annex. 


* special eetegories of cited doounetile: 'T* 

*A" docwment defining ibe general ttale of Ihe art which U not eoneidered 
Id be of particuUr relevanca 

•V" 

*B* eerlier docxnnent published on or efter the internetioDit fUing deti 

*L' document which ney throw doubts on prioriQr claim (i) or which u 

cited to eitebliib the publioetion dete of eoother citetion or other ^ 
ipeoial reason (es specified) ^ 

*0* document referring to an oral disclosure, use, exhibiUon or oUier 
meeos 

■p* docure ent published prior to (be intematioaal filing dete Imt bter than • 
the priori^ date claimed 


later document published after the international filing date or priority 
dete end not in conflict with the epplioetion but oited to undentaiid 
the principle or dieoiy underlying the invention 

document of particular relevance; the cbuned invention cannot l>e 
oonsidered novel or cannot be considered to involve en inventive step 
when die document is taken clone 

document of particular relevence; the olaimed invention cannot be 
oonsidered to involve an inventive step when the document is 
combined with one or mote other such dootunent^ such combination 
being obvious to • peison skilled in the art 

document member of (ha same patent family 


Dgte of the actual completion of tho international search 
08 APRIL 1998 


Date of mailing of the interaational search report 

2 8 JUL m 



Name and mailing address of the ISAAJS 
Commissioner of Patents and Trademarks 
BoxPCT 

Washington, D.a 20231 
Faeaimtle No. n03^ 305-3230 



icer 



John Peng 
ilephone No. r703) 305-4702 



